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A Comparison of Two 
Estimates:of Standard Error 
for a'Ratio-of-Means Estimator 
for a Mapped-Plot Sample 
Design in Southeast Alaska 


Willem W.S. van Hees 


Comparisons of estimated standard error for a ratio-of-means (ROM) estimator 
are presented for forest resource inventories conducted in southeast Alaska 
between 1995 and 2000. Estimated standard errors for the ROM were generated 
by using a traditional variance estimator and also approximated by bootstrap 
methods. Estimates of standard error generated by both traditional and boot- 
strap methods were similar. Percentage differences between the traditional and 
bootstrap estimates of standard error for productive forest acres and for gross 
cubic-foot growth were generally greater than respective differences for non- 
productive forest acres, net cubic volume, or nonforest acres. 


Keywords: Sampling, inventory (forest), error estimation. 


Between 1995 and 2000, the Pacific Northwest Research Station (PNW) Forest 
Inventory and Analysis (FIA) Program in Anchorage, Alaska, conducted a land 
cover resource inventory of southeast Alaska (fig. 1). Land cover attribute esti- 
mates derived from this sample describe such features as area, timber volume, 
and understory vegetation. Each of these estimates is subject to measurement 
and sampling error. Measurement error is minimized through training and a 
program of quality control. Sampling error must be estimated mathematically. 


This paper presents a comparison of bootstrap estimation of standard error for 
a ratio-of-means estimator with a traditional estimation method. Bootstrap esti- 
mation techniques can be used when a complex sampling strategy hinders 
development of unbiased or reliable variance estimators (Schreuder and others 
1993.) Bootstrap techniques are resampling methods that treat the sample as 

if it were the whole population. Repeated samples are taken, with replacement, 
from the original sample and the statistic of interest is calculated for each sample. 
The average of the statistic over all the samples is the bootstrap estimator. 


This study was conducted to examine briefly whether or not traditional estimates 
of standard error differed in some meaningful way from the bootstrap approxi- 
mation. It was felt that the two estimates would produce substantially similar 
results. 


Willem W.S. van Hees is a research forester, Forestry Sciences 
Laboratory, 3301 C. St., Suite 200, Anchorage, AK 99503. 
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Figure 1—Southeast Alaska inventory region, 1995-2000. 
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In lieu of extensive simulations, multiple bootstrap estimates of standard error, along 
with traditional estimates, were made for each of five population parameters in three 
sampling units. These parameters, for unreserved USDA Forest Service lands, were 
productive forest-land acres, nonproductive forest-land acres, nonforest acres, net 
cubic-foot volume, and gross cubic-foot growth in the Chatham, Stikine, and 
Ketchikan inventory units (van Hees 2001a, 2001b, 2001c). 


Land cover of the southeastern panhandle of Alaska (fig. 1) was sampled with a 
single-phase, unstratified, systematic grid sample (grid spacing was 4.8 kilometers). 
Ground plots (1 hectare) were established at each grid intersection and were sub- 
sampled by a cluster of four, 7.3-meter, fixed-radius subplots. Three subplots were 
sited, one each at 63.4 meters north, southeast, and southwest from the first, cen- 
trally located subplot. Each subplot was mapped for land cover (Scott and Bechtold 
1995.) 


Estimation of resource attributes such as area and timber volume used ratio-of- 
means estimators. The ratio-of-means estimator and associated traditional variance 
estimate are defined as (Cochran 1977): 


where 


y; = the variable of interest on plot i, 
X; = an auxiliary variable (such as area) on plot i that is correlated with y;, and 
fi = number of plots selected from the population, 


with variance 


v(R) = ———— (D197 +R’ D7 -2RD ii) - (2) 


mc 


Zarnoch and Bechtold (2000) demonstrate use of this ratio estimator to generate 
various population estimates from data collected by using a sampling design similar 
to that described above. Essentially, the ratio estimate defined by equation (1) is 
multiplied by some total, such as area, to estimate the amount of the total in the 
condition of interest (y; ). 
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Table 2—Differences between bootstrap and traditional estimates of standard errors as a percentage of the boot- 
strap estimate, by number of bootstrap iterations, sampling unit, and population attribute 


Number of bootstrap iterations 


Sampling unit/ 
population attribute = ~--- nnn nnn enone CS a cra aaa 15000 --ooo-—> == 3,000 
SSRIS SSIS SERIES SSO TOSS SISA [RBG sacso2 2s sar Ons sSameebas = Sais Sansa SasaSS ease 
Ketchikan: 
Productive forest, acres 5.42 -1.09 -2.03 1.64 0.71 
Nonproductive forest, acres 5.52 2.53 -0.51 1.64 eval 
Nonforest, acres 3.79 3.35 -1.68 7.06 0.00 
Net cubic-foot volume 4.19 -4.51 -0.76 -4.24 -3.13 -2.64 -4.30 
Gross cubic-foot growth 7.55 3.79 6.08 2.34 4.79 5.67 4.41 
Stikine: 
Productive forest, acres 3.18 -3.52 4.80 -5.24 2.89 
Nonproductive forest, acres 1.06 -3.94 1.33 -0.35 3.70 
Nonforest, acres 3.65 -1.19 3.59 -4.19 1.09 
Net cubic-foot volume 1.15 0.19 -1.29 -6.41 -0.79 -0.70 
Gross cubic-foot growth 0.29 4.58 -2.80 -3.27 2.84 1.67 
Chatham: 
Productive forest, acres 2.09 -4.44 2.44 -3.93 =i. -1.52 
Nonproductive forest, acres -0.88 6.78 -0.02 -0.98 2.95 4.22 
Nonforest, acres -3.48 1.28 2.81 -3.90 -4.21 0.46 
Net cubic-foot volume -1.15 -3.97 0.22 3.19 -4.85 -0.95 -0.61 1.99 4.98 
Gross cubic-foot growth 1.38  -4.08 -0.46 5.73 -2.00 1.38 1.54 3.20 B17 
Bootstrap Estimate Bootstrap estimation of the variance was accomplished by iterative random sam- 
pling, with replacement, of the plot list to generate a new plot list. Within each plot, 
subplots were randomly selected, with replacement, to generate a new subplot list 
for each plot. The ROM estimates of population totals were then recomputed. The 
variance of the estimated totals provides an estimate of the sample variance. This 
process was repeated 500 to 3,000 times. At least four bootstrap estimates, for each 
of the five population parameters, in all three sampling units, were made by using 
500 iterations. Greater numbers of iterations (1,000 and 3,000) were used fewer 
times and for increasingly fewer population parameters. 
Although bootstrap samples are not independent, variance estimates resulting from 
them are considered conservative approximations (Schreuder and others 1993). 
Results Bootstrap and traditional estimates of standard errors are presented in table 1. In 


no case did the bootstrap estimate differ from the traditional estimate by more than 
7.55 percent (table 2). Eleven of 92 observations were more then 5 percent differ- 
ent; the remaining 81 bootstrap estimates were less than 4.99 percent different from 
the ROM estimate. The larger percentage differences (greater than + 5.5 percent) 
are not specific to a particular inventory area or estimated population parameter 
(figs. 2 through 6). 
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Figure 2—Differences between bootstrap and traditional estimates of standard errors as a 
percentage of the bootstrap estimate, by number of bootstrap iterations, for estimates of 
productive forest-land area within unreserved national forest lands, southeast Alaska. 
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Figure 3—Differences between bootstrap and traditional estimates of standard errors as a percent- 
age of the bootstrap estimate, by number of bootstrap iterations, for estimates of net cubic-foot 
volume on productive forest-land area within unreserved national forest lands, southeast Alaska. 
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Figure 4—Differences between bootstrap and traditional estimates of standard errors as a 
percentage of the bootstrap estimate, by number of bootstrap iterations, for estimates of non- 
productive forest-land area within unreserved national forest lands, southeast Alaska. 
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Figure 5—Differences between bootstrap and traditional estimates of standard errors as a 
percentage of the bootstrap estimate, by number of bootstrap iterations, for estimates of non- 
forest-land area within unreserved national forest lands, southeast Alaska. 
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Figure 6—Differences between bootstrap and traditional estimates of standard errors as a 
percentage of the bootstrap estimate, by number of bootstrap iterations, for estimates of gross 
cubic-foot growth on productive forest-land area within unreserved national forest lands, south- 
east Alaska. 


For the response variables listed, there is little difference between the two estimates. 
The largest percentage differences between error estimates are in the Ketchikan 
unit. The forest resource of the Ketchikan unit is more variable than in the other 
two units; it is ecologically transitional (approaching the southern extent of the Sitka 
spruce/western hemlock zone), and logging has been more intensive and extensive 
resulting in greater variety of age and size classes. Greater variability between 
bootstrap and traditional estimates may indicate the number of iterations was low 
for those estimates. 


Relative rapidity of data processing is a significant client service consideration. 
Rapid responses are important when providing clients with inventory results. 
Although bootstrap estimates can be generated for any of the population estimates 
FIA produces, the computational resources needed to generate those estimates for 
each cell in all the output tables typical for FIA reporting exceed those needed for 
ROM estimates. Use of the ROM estimator reduces production time dramatically. 


Kevin Dobelbower, Team Leader for Information Management, Anchorage, Alaska, 
created and ran necessary computer programs for this study. 


0.3048 meter = 1 foot 

0.0283 cubic meter = 1 cubic foot 
0.4047 hectare = 1 acre 

1.609 kilometers = 1 mile 
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